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Abstract — Codes constructed from connected spatially coupled 
low-density parity-check code (SC-LDPCC) chains are proposed 
and analyzed. It is demonstrated that connecting coupled chains 
results in improved iterative decoding performance. The con- 
structed protograph ensembles have better iterative decoding 
thresholds compared to an individual SC-LDPCC chain and 
require less computational complexity per bit when operating 
in the near-threshold region. In addition, it is shown that the 
proposed constructions are asymptotically good in terms of 
minimum distance. 

I. Introduction 

Recently, iterative processing on spatially coupled sparse 
graphs has received a lot of attention in the literature. The 
concept of coupling a sequence of identical small structured 
graphs into a chain with improved properties, first demon- 
strated in the context of LDPC convolutional codes yj, has 
been shown to be applicable to a diverse list of topics, such 
as compressed sensing |2|, multiuser communication |T| p], 
quantum codes |5|, and models in statistical physics |6|{] 

Ensembles of spatially coupled LDPC codes (SC-LDPCCs) 
can be obtained by terminating regular LDPC convolutional 
code ensembles [7J. The slight irregularity resulting from the 
termination of the convolutional codes has been shown to 
lead to substantially better belief propagation (BP) decoding 
thresholds compared to coiTesponding block, or uncoupled, 
code ensembles for a variety of channels |7|-|10|. Further, it 
has recently been proven analytically for the binary erasure 
channel (BEC) that the BP decoding thresholds of regular 
SC-LDPCC ensembles approach the maximum a posteriori 
probability (MAP) decoding thresholds of the corresponding 
LDPC block code ensembles | fTT[ . 

The reduced check node degrees at the ends of the spatially 
coupled chain result in highly reliable information, which 
then propagates through the SC-LDPCC chain during the 
iterative decoding process. As a result, this 'flow' of reliable 
information leads to improved iterative decoding performance. 
However, a large number of iterations, and consequently 
a large amount of computation, is needed for the coded 
symbols in the middle of the chain to be decoded reliably. 
Improved iterative decoding schedules that attempt to reduce 
the number of computations per bit to practically reasonable 
values have recently been proposed. These include windowed 
decoding fT2], for which updates of the reliability values 
are performed within a window sliding along the coupled 
chain, as well as a decoding schedule where updates are only 
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performed for nodes where there is a potential improvement in 
the reliability value |13|. These improved schedules guarantee 
that the number of computations per bit is independent of 
the length of the chain. However, further improvement is 
challenging for single, linear, spatially coupled chains. 

In this paper, we propose to connect several individual 
chains of spatially coupled graphs to form more general 
graphs. The reliability information that propagates through 
the individual chains during the iterative decoding process 
may now spread in multiple directions, thus triggering further 
performance improvement. This decoding improvement can 
come from check nodes of reduced degree or variable nodes 
of increased degree, and it can arise simultaneously in several 
parts of the graph and then combine to facilitate decoding 
convergence. We demonstrate improved iterative decoding 
thresholds for the binary erasure channel (BEC) and the 
additive white Gaussian noise (AWGN) channel and a reduced 
number of computations per bit required to reach a desired 
probability of error. Moreover, we show that the connected 
structures, like the individual chains, are asymptotically good. 
Although in this paper we limit our study to a construction 
consisting of two parallel linear coupled chains connected by 
two bridges, the concept can be easily generalized. 

II. Code Construction 

We start by describing a SC-LDPCC ensemble in terms of 
its protograph representation. A protograph fT4| is a small 
bipartite graph connecting two sets of nodes, a set of variable 
nodes and a set of check nodes. A protograph which represents 
a terminated chain of coupled (3, 6)-regular LDPC codes of 
length L = 8 is shown in Fig. [TJ^)- The variable nodes are 
black and the check nodes are green. Each variable node is 
connected to 3 check nodes and each check node is connected 
to 6, 4, or 2 variable nodes. The associated bi-adjacency matrix 
B of this protograph is called the base matrix. 

The parity-check matrix H of a protograph-based LDPC 
block code (a member of the ensemble) can be created by 
replacing each non-zero entry in B by a permutation matrix 
of size M (for protographs with single edge connections) and 
a zero entry by the M x M all-zero matrix. In graphical 
terms, this can be viewed as taking an Af-fold graph cover or 
"lifting" of the protograph. The parameter AI is refeiTed to as 
the lifting factor. It is an important feature of this construction 
that each lifted code inherits the degree distribution and local 
graph neighborhood structure of the protograph. 

The protograph chain shown in Fig. [TJa) can be viewed 
as a row of simple vertical graphs (segments) where two 
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Fig. 1. A spatially coupled (3, 6) protograph chain of length L - 
its simplified representation (b). 



1 (a) and Fig. 3. Two parallel (3, 6) protograph chains of length L 
by two bridges of length Lj, = 6 each. 
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variable nodes are connected to the check node located in 
between. These segments are then coupled, i.e., each segment 
is connected to one segment on the left and one on the right 
(see Fig. [TJb)). To effect termination, one extra check node 
is required at each end of the chain. Coupling a sequence 
of graphs in such a way has two immediate consequences: 
1) there is a loss in rate that diminishes as the length L of 
the chain grows, and 2) we observe a threshold improvement 
compared to the uncoupled LDPC code ensembles. 

A. Construction: Two Chains Connected by Two Bridges 

Two protograph chains may be connected as shown in 
Fig. [2] The horizontal chain continues to the left and right 
while the vertical chain is terminated at the top. The first 
check node at the top of the vertical chain has degree two 
and the second node degree four. Therefore, in order to form 
degree six check nodes, we connect the first check node of 
the vertical chain to variable nodes of the horizontal chain 
with four additional edges and the second check node of 
the vertical chain to variable nodes of the horizontal chain 
with two additional edges. As a result, the degrees of several 
variable nodes in the horizontal chain are increased by one. 
The new edges are shown in red in Fig. |2] 




Fig. 2. Two connected spatially coupled (3, 6)-regular protograph chains. 
The connecting edges are shown in red. 

We now consider two horizontal chains connected by two 
vertical chains that we call bridges. An example of such a 
construction is given in Fig. |3] The length of both horizontal 
chains is 12, while each bridge is of length 6. Each of the four 



connections between bridges and chains is made as shown in 
Fig.|2] 

Generalizing this example, we consider an ensemble of 
protographs, denoted by 5(3, 6, L), that consists of two chains 
of length L that are connected by two bridges of length L/2. 
The connecting points are located at a distance of [L/4J from 
the ends of the chains. The rate of the ensemble 5(3, 6, L) is 
given by 

i?(5(3,6,L))^^^i-A. (1) 
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III. Analysis of connected SC-LDPCCs 

A. Iterative decoding analysis 

Since every member of the protograph-based ensemble pre- 
serves the structure of the base protograph, density evolution 
analysis for the resulting codes can be performed within the 
protograph. In this section, we discuss density evolution for 
the case of the BEC (iterative decoding threshold results are 
also presented for the AWGN channel in Section IV i. We 



assume that BP decoding is performed after transmission over 
a BEC with erasure probability e. In every decoding iteration, 
all of the check nodes are updated followed by all of the 
variable nodes. The messages that are passed between the 
nodes represent either an erasure or the correct symbol value 
(0 or 1). 

We denote the set of variable nodes connected to check 
node k by Y{k), k = 1, 2, . . . , 3L + 8, and the set of check 
nodes connected to variable node j hy C{j), j = 1,2, . . . , 6L. 
The probability that the message passed from check node k to 
variable node j in iteration i is an erasure is denoted by qj,^ . 
The probability of an erasure message from variable node j 
to check node k is similarly denoted by The following 
equations relate the erasure probabilities of the messages at 
different iterations: 



j'ev(fc)xj 
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The variable node messages are initialized as p 
iteration 0. The error probability of the variable nodes at 
iteration i can be calculated as 
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The error probability evolution equations given above in- 
dicate that an increase in the number of variable node con- 
nections will improve the decoding performance (lower the 
erasure probability), while an increase in the number of check 
node connections will degrade it. Therefore, each connection 
between a protograph chain and a bridge in the ensemble 
5(3, 6, i) is made by connecting some of the variable nodes 
in the chain to the check nodes with reduced degrees at the 
end of the bridge (see Fig. |2]i. The degrees of the check nodes 
in the resulting construction do not exceed 6, while some of 
the variable nodes involved in the connection have degree 4 
instead of 3. 

Focusing on a reduction in complexity, we consider si- 
multaneous decoding of the entire code graph, where we 



employ the updating schedule proposed in 1 1 3 1 . The algorithm 
designates a target convergence probability Pb.max as well as 
an update improvement constraint 9. Regular message passing 
updates are performed for each variable or check node with 
the exception of the following conditions: 

► no update for variable node j is performed if the error 
probability _Pb(j) < ^b.max; 

► no update for any variable node j, or any check node 
k, is performed if all the nodes in C(j), or V(fc), 
respectively, were not updated in the previous iteration; 

► no update for variable node j is performed if the 
potential improvement of the bit error probability is less 
than 6, i.e.. 



-Pb,old(j) - J^b,new(j) 
A,old(i) 



< 



(5) 



It can be observed that, during every iteration, different 
sets of nodes are active in the graph. The convergence of 
the error probability spreads from the ends of the parallel 
chains into the main square of the graph (see Fig. |3]l. As will 
become evident later in this section, the sets of nodes with 
the fastest convergence are known in advance, so scheduling 
can be arranged such that the best set of nodes is transmitted, 
received, and decoded first. This set is then followed by the set 
of nodes with the second fastest convergence, which is then 
transmitted and decoded, and so on. This approach, suitable for 
the ensemble 5(3, 6, L), can be seen as an attractive alternative 
to the windowed decoding approach (which is a good choice 
for decoding an individual SC-LDPCC chain C(3, 6, L))Q 

We now shift our focus to the error probability performance 
of the ensemble S{3,6,L). We consider SC-LDPCC chains 
of length L = 24, a target error probability Pb.max — 10^^, 
and an update threshold 6 — 10^^. The evolution of the 
bit error probability for the first horizontal chain of the 
ensemble S{3, 6, 24) is depicted in Fig. |4] The red curves 
(from top to bottom) correspond to the error probabilities P\, 
at iterations i = 1, 6, 11, . . . , 51. The green curves are the 
error probabilities Pb computed for the single chain ensemble 
C(3, 6, 24) at iterations i — 1,6,11,..., 51. We can see that 
the variable nodes in the chain that are connected to the two 

'in windowed decoding |l2| , it is assumed that tlie decoder operates on a 
window of W coupled graph segments. All of the graph segments preceding 
the current window are already decoded, and all of the graph segments 
following the window are yet to be processed. 



bridges form two clusters which start to converge faster than 
the remaining nodes in the chain. Although the clusters are not 
strong enough to make the entire chain converge to the desired 
Pb.max, they facilitate the overall convergence process. We 
observe convergence for the connected SC-LPDCC ensemble 
5(3, 6, 24) happening much faster than that of the ordinary 
SC-LDPCC ensemble C(3,6,24). 
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node position in the chain 

Fig. 4. Logarithm of the bit error probability for the variable nodes of the 
first chain of the ensemble cS(3,6,24) (red curves) and for the ensemble 
C(3,6,24) (green curves), as a function of the position of the node in the 
chain. The curves (either red or green) are computed for decoding iterations 
1, 6, 11, . . . , 51 (from top to bottom). The positions of the two bridges are 
shown by the red triangles. 

Fig. [5] presents a magnified picture of the Pb evolution. 
The red curves correspond to the ensemble 5(3, 6, 24) and the 
green curves to the ensemble C(3,6, 24). Both sets of curves 
are computed for iterations i = 1,2,..., 7. We notice that 
the error probability at the position of the bridge connection 
becomes irregular compared to its neighborhood, even for the 
second iteration. As a result, the nodes with higher reliability 
appear at the four bridge connection positions along the chain. 
These nodes force the intermediate low reliability nodes to 
converge faster Consequently, in the initial iterations, the ir- 
regularity of the error probability curve facilitates convergence, 
and the usual bell-like shape only appears as the iterations 
proceed. In contrast, the green Pb curves, corresponding to 
the individual SC-LDPCC chain, assume a smooth bell-like 
shape from the beginning, and we observe that there is no 
irregularity present to speed up convergence. 

The evolution of the probabilities Pb for the nodes in the 
bridge is shown in Fig. |6] The curves correspond to iterations 
i = 1,6,11,. ..,51. Convergence in the bridge starts slowly, 
since the connections, even though the 'strong' variable nodes 
of higher degree are included, are not able to produce the 
same boost of reliability information as the low degree check 
nodes at the ends of each parallel chain. However, as the 
parallel chains converge, they essentially "disappear" and the 
bridge appears to be left disconnected, or "hanging in the air". 
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Fig. 5. Bit eiTor probability for the variable nodes of the first chain around 
the bridge connection. The red curves correspond to the ensemble 5(3, 6, 24) 
the green curves to the ensemble C(3, 6, 24). The curves (either red or green) 
are computed for decoding iterations 1, 2, . . . , 7 (from top to bottom). The 
position of the bridges is shown by the red triangle. 

At that time, the convergence of the bridge evolves as if it 
were a regular SC-LDPCC chain. Note that the length L/2 
of the bridges has been selected in order to ensure that their 
convergence occurs simultaneously with the convergence of 
the parallel chains. 

B. Minimum distance analysis 



In 1 15 1, Divsalar presented a technique to calculate the 



average weight enumerator for protograph-based block code 
ensembles. This weight enumerator can be used to test if an 
ensemble is asymptotically good, i.e., if the minimum distance 
typical of most members of the ensemble is at least as large as 
Smin^, where Sj^in its the minimum distance growth rate of 



the ensemble and n is the block length. In 1 16|, it was shown 
that ensembles of (J, i^)-regular SC-LDPCCs (i.e., individual 



chains) are asymptotically good. In Section IV we present the 
results of a similar protograph-based analysis for ensembles of 
connected SC-LDPCCs to see if they share the good distance 
properties of the individual chains. 

IV. Results 

In this section, we present a number of results for the 
constructed 5(3,6, L) ensembles. We start by considering 
transmission over the BEC using the complexity saving de- 



coding schedule discussed in Section III The target error 
probability Pb.max is set to 10^^. The number of updates 
per node /gff (for both check and variable nodes, including 
the chains and bridges), averaged over the node positions, is 
considered as a measure of decoding complexity. 

The average number of updates per node /eft required to 
achieve Pb.max = 10^^ is plotted in Fig. [t] as a function of the 



Fig. 6. Logarithm of the bit eiTor probability for the variable nodes of the 
first bridge as a function of the position of the node in the bridge. The curves 
(from top to bottom) correspond to iterations 1, 6, 11, . . . , 51. 

BEC parameter e. The red and magenta curves correspond to 
the proposed ensemble 5(3, 6, 24), while the blue and black 
curves are computed for a single SC-LDPCC chain of length 
L = 18, i.e., ensemble C(3,6, 18)[5 The magenta and black 
curves correspond to the updating schedule with the improve- 
ment constraint — 10^^, while the red and blue curves 
correspond to 6* = (in which case, updates are performed 
regardless of the potential error probability improvement). We 
observe a significant complexity improvement provided by 
the connected SC-LDPCC chain construction^ The vertical 
straight lines indicate the iterative decoding thresholds cal- 
culated for each construction with the corresponding update 
schedule, and we note that the ensemble 5(3, 6, 24) has better 
iterative decoding thresholds then C(3, 6, 18). 

Iterative decoding thresholds for a number of 5(3, 6, L) 
ensembles on the BEC are given in Table |l] The thresholds 
are compared with the thresholds of the regular coupled 
chains of (approximately) the same rate. The thresholds for 
the AWGN channel, computed using a discretized density 
evolution method, are given in Table |ll] An improvement in 
the threshold values can be observed for all SC-LDPCC chain 
lengths L = 8, 12, 16, 20, and 24 considered. 

Minimum distance growth rates for several connected 



5(3, 6; L) SC-LDPCC ensembles are shown in Table III 
We observe that, like the individual component SC-LDPCC 
chains, the 5(3, 6, L) ensembles are asymptotically good. As 
the length of the parallel SC-LDPCC chains increases, the 

-Ensembles cS(3, 6, 24) and C(3, 6, 18) have been selected for comparison 
since they both have design rates approximately equal to 0.444. 

Although 12 variable nodes in the ensemble cS(3,6,24) have degree 
4 instead of 3, the difference in the computation per node it causes is 
insignificant with regard to the overall obtained improvement. 




Fig. 7. The average number of updates per node I^ff as a function of tlie 
BEC parameter e for the 5(3, 6, 24) ensemble (magenta and red curves) and 
the C(3,6, 18) ensemble (blue and black curves). The magenta and black 
curves are computed for the updating schedule with improvement constraint 
9 = 10~^, while the red and blue curve are for 8 = 0. Corresponding 
thresholds are given by vertical lines. 



Rate 


Ensemble 


e* 


Ensemble 


e* 


0.3333 


5(3,6,8) 


0.563 


C(3,6,6) 


0.557 


0.3889 


5(3,6, 12) 


0.538 


C(3,6,9) 


0.512 


0.4167 


5(3,6,16) 


0.522 


C(3,6,12) 


0.495 


0.4333 


5(3,6,20) 


0.504 


C(3,6, 15) 


0.489 


0.4444 


5(3,6,24) 


0.495 


C(3,6, 18) 


0.488 



TABLE I 

BEC THRESHOLDS e* FOR SEVERAL SC-LDPCC ENSEMBLES cS(3, 6, L) 
AND SINGLE CHAIN ENSEMBLES. 

design rate increases, the thresholds approach capacity, and the 
minimum distance growth rate decreases. This is analogous to 
the effect of increasing the length L of the individual SC- 
LDPC chain C(3,6, L) |16|. However, the main advantage 



that a connected SC-LDPCC ensemble 5(3, 6, L) has over the 
individual ensemble C{3,6,L) is that the connected structure 
of 5(3, 6, i) permits the reliability information to spread 
in multiple directions and facilitate decoding convergence, 
resulting in a reduced number of computations per bit required 
to reach a desired probability of error in addition to a threshold 
improvement. 

V. Conclusions 

In this paper, a construction of asymptotically good 
protograph-based ensembles using connected SC-LDPCC 
chains was presented. Transmission over both the BEC and the 
AWGN channel along with iterative message passing decoding 
have been considered. It was demonstrated that connecting 
coupled chains improves the iterative decoding thresholds 
and reduces the decoding complexity per bit compared to 
individual SC-LDPC chains. The results suggest that the 
threshold saturation effect shown in [llj may be even more 
pronounced when the coupling is not restricted to a single 
linear connection. 



Rate 


Ensemble 


(-Bb/iVo)* 


Ensemble 




0.3333 


5(3,6,8) 


1.0167dB 


C(3,6,6) 


1.1894dB 


0.3889 


5(3,6,12) 


0.7512dB 


C(3,6,9) 


1.1701dB 


0.4167 


5(3,6,16) 


0.7231dB 


C(3,6,12) 


1.1167dB 


0.4333 


5(3,6,20) 


0.8079dB 


C(3,6, 15) 


1.0431dB 


0.4444 


5(3,6,24) 


0.8367dB 


C(3,6, 18) 


0.9659dB 



TABLE II 

AWGN CHANNEL THRESHOLDS (Eb/Nq)* FOR SEVERAL SC-LDPCC 
ENSEMBLES 5(3, 6, L) AND SINGLE CHAIN ENSEMBLES. 



L 


Rate 




L 


Rate 




8 


1/3 


0.0137 


16 


5/12 


0.0054 


10 


11/30 


0.0095 


18 


23/54 


0.0049 


12 


7/18 


0.0075 


20 


13/30 


0.0043 


14 


17/42 


0.0062 


24 


4/9 


0.0036 



TABLE III 

Minimum distance growth rates for several connected 
sc-ldpcc ensembles 5(3, 6, l). 
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